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This paper reports on two comprehensive 
multi-institutional collaborative efforts for school improvement. The 
two studies demonstrate that collaborative efforts involving multiple^ 
agencies and multiple agendas can be successful even when separated 
by considerable geograf^ical distance. The school systems were 
concerned with implementi<ng a locally developed curriculum; 
researchers, meanwhi^le, were investigating the implementation process 
and providing training. The conceptual framework used in both 
programs, the Concerns Based Adoption Model (CBAM) , is summarized. 
Its diagnostic dimensions (Stages of Concern about the Innovation, 
Levels of Use of the Innovation, and Innovation Configuration) are 
discussed. The planning, implementation, and evaluation of the two 
case studies are summarized: the Jefferson County (JeffCo) (Colorado) 
Schools program to improve elementary science curriculum and 
instruction; and the Palm Beach (Florida) Schools development and 
implementation of the Unified Curriculum program. The Jef.fCo case 
provides a clear example of a concerns-based implementation effort 
and illustrates how the diagnostic dimensions of the CBAM can be used 
to plan, monitor, and intervene in improvement efforts. Addressing 
teacher concerns is emphasized. The Palm Beach study emphasizes 
principal inservice training for the role of implementaion 
facilitation. The collaboration of research teams from schools 
mentioned above and from the Research and Development Center for 
Teacher Education at ^he University of Texas at Austin led to the 
formulation of seven key principles for school improvement; six 
important unresolved issues are also presented. (BS) 
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Around the globe the banner of. school Improvement flies hopefully 
over school buildings large and small, old and new, elegant and ugly. 
Improvement efforts, at this moment, are Underway In. the snowy northern 
climes of various provinces. In the hot and dry terrain of many lands. 
In steamy areas of other countries. In widely separated states of the 
North American continent — Colorado, Florida, _an^ 
henslve multl-lnstUutlonal school Improvement efforts occurred. They 
are summarized In this paper. The two studies demonstrate that collabo- 
rative efforts InvolvlTig multiple agencies and multiple agendas can be 
successful even when separated by consldeihable geographical distance. 
The participants In these case studlej Included teachers, curriculum 
dev^lo^ers, staff developers, principals, school administrators, 
evaluators and researchers. The efforts were intensive, resulted In 
growth for all participants and were docuigented by qualitative and 
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quantitative data that confirm that positive outcomes and accomplish- 
ments' resulted. In addition thn studies produced new Ideas 'about how to 
make future school Improvement efforts even better.' " 

The experiences and Institutional activities that are summarized 
here clearly resonate with the principles that have been articulated by 
the International School Improvement Project (ISIP) (Van Velzen, 1982). 
Although the ISIP project had not been created at the time that these 
Improvement efforts began, the experiences reinforce the guiding 
principles advanced in the ISIP project. 

The participants In this set of cases shared a common conceptual 
framework of the change process. This conceptual framework Is outlined^ 
In the Concerns Based Adoption Model (CBAM), (Hall, Wallace & Dossett, 
1973). While Implementation of locally developed curriculum was the 
primary concern of the Colorado and Florida practitioners, research on 
the Implementation process was of major interest to the Texas 
researchers. Through tne use of the shared conceptual framework of the 
Concerns Based Adoption Model all of the agenda could be addressed. In 
addition, all parties could use common language for uhderstanding, 
communicating, facilitating, monitoring and evaluating" the improvement 
efforts. ' 

This paper is organized so that the reader can learn about the 
inter-Institutional collaborative efforts, the improvement processes 
used and the research that was conducted. In the first section the^ 
diagnostic dimensions of the Concerns Based Adoption Model which were 
used in these cases &re summarized. These diagnostic dimejisions are 
Stages of Concern about the Innovation, Levels of Use of the Innovation 
and Innovation Configurations. Some mention wIlJl be made of the 



research that focused on the concept of Intervention. New understanding 
about the characteristics of interventions Mas a key outcome of thje 
— school-improvement "processes and' the^fexp^ftencf s that^are "surnnarized In 
these cases. 

The second t^jor section of the paper Introduces the first of the 

* • • . ' 

two case studies, the implementation of , the Revised Science Curriculum 
in Jeffersop County, Colorado.. This section is followed by the 
description of improvement efforts in. the Palm Beach County school 
district In Florida. In .Palm Beach the focus of the improventent effort 
was on implementation of the ^ Unified Mathematics Curriculum in 
elementary schools. A brief suninary highlights critical features and 
some key principles that were gained from the two studies and which 
appear to have: Important implications for future improvement efforts. 
The paper concludes with a discussion of some unresolved issues along 
with suggestions for future research, development and refinement of 
scliool improvement practices. 

The Participants 

* 

The staffs of three different agencies in three different parts, of 
the United States are the major actors in this ..collaborative effort.. 
One staff was led by central office science curriculum coordinajtors and 
administrative staff developers in Jefferson County, Colorado (Jeff Co). 
The second staff was directed by the staff development office of Palm 
Beach County Schools, Florida. The third staff was the team of 
researchers at the Research and Development Center for Teacher Education 
(Texas R&D Center) at the University of Texas at Austin, who were 
studying the change process in schools and colleges. 



In the years before 1975 the Jeff Co district had surveyed teachers, 
parents and others' about the needs In elementary school^ science atid had 
nmed--th«w9h-the~dlstrict -procedure developi-ng new^curriculum. In 
1976^ they were ready to\ implement the newly developed and tested 
curriculum district wide. The Texas group at that time was preparing to 
launch a major longitudinal study of implementation. The two groups 
joinea forces to facilitate and study the implementation of the Jeff Co 
Revised Science Curriculum. 

Data were collected over the next four years. As the district used 
the diagnostic c^mensions of the Concerns Based Adoption Model to 
facilitate the implementation effort in 80 elementary schools, the Texas 
■staff used the same concepts to systematically study the implementation 
process in a subset of twenty elementary schools. The. study placed 

.5- 6 

heavy emphasis on analyzing what occurs at the individual teacher and 
classroom level when educational innovations are Introduced. 

^^In 1978' the Palm Beach County staff began to make plans* to 
Implement a Unified Mathematics curriculum in elementary schools. They 
contacted Jeff Co staff to see what could be learned that could be 
applied in the Florida • implementation effort. The Texas group joined 
the Floridd effort td again study Implementation, but this time with a 
heavy focus on the role of the school principal. Again the CBAM 
concepts were iised in training personnel and in facilitating the' 
Implementation effort. 

The two cases and their stories, which comprise the bulk of this 
paper, are similar in several respects. They report the fffort of two 
rather large school districts. Each' is large in terms of student 
population and in geographical size. Each district's effort was baseo 



on a locally developed curriculum Innovation and the Implementation 
process was guided by strong central office s'taff developers and 
curriculum consultants. ^ , ^ 

The reports of the two stories unfold in rather parallel fashion 
thou^gh there are obvious differences. The extensive description In the 
Jeff Co case is a clear example of a concerns based implementation effort ^ 
and Illustrates and explains how the diagnostic dimensions of the CBAH 
can be used to plan, monitor and intervene in Impi^vement efforts. A 
great deal of detail is Included about the inservlce interventions 
provided for teachers, which illustrates how interventions can be 
designed to address teachers concerns. The Palm Beach story which 
follows if. more concise ^nd emphasizes the inservice training of 
principals for the role of implementation facilitation. The Palm Beach 
story began to develop approximately two and a half years after the 

f 

Jeff Co study. Key leaders in the Palm Beach district maintained contact 
with their count .rparts in the'JeffCo experience, thus what was learned 
In JeffCo could be adjusted and appUed In the Palm Beach implementa- 
tlon effort. 

With both districts the staff^ f rom the Texas R&D Centef- studied 
the Implementatioti process- and provided training for the change 
facilitators. Although the R&D Center staff were agents external to the 
districts they became equ'^l partners in the implementation efforts. One 

a 

important consequence was the opportunity for the districts to have 
access to the newest concepts out of Implementation research and it was 
possible for researchers to have the opportunity to study closely large 
scale Improvement efforts as they unfolded. 



An Organizing Fratnework , „ 

Sloce thfere are so many variables and processes to consider, we 
Mould like to use a simple framework to organize this paper and our 
Ideas about school' Improvement. This framework was born out of our' 
discussions about the . distinctions between school improvement, the 
school review process. Implementation and the roles of school' leaders, 
evalua tors and policy makers. The'jnajor blocks In the framework are the 
School Review Process, Solution Selection/Development and Solution 
Implementation. Graphically the framework Is Illustrated In Figure 1. 
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Figure 1 Organized Framework for Viewing 
School Improvement Processes 
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The school review process Incorporates the period of tim and 
activities that occur as a school staff reviews and examines Its 
strengths, weaknesses and problems In relation to its goals. This 
process will normally include all or nearly all of the '.school staff and 
-draw upon the advice and fexpertlse of agents external to the school. 

. The outcoine of the school review process is the Identification of. 
one or more "solutions" that if adopted could lead to improved school 
practice. In some instances potential solutions may already < be 
available from outside agencies, such as publishers. In other cases 

... « ^ 

such as with Jeff Co and Palm Beach the schools develop their own 
r.^lution. i . 

» ' Implementation of the selected solution is the third major segment 
' of the school improvement process. Identifying solutions and ignoring 
implementation or tre.at1ng Implementation as an event will, mean that 
little or no change in school practice results from the review process. 
The implementation process takes time and resources just as the review 
and development processes do^ 

t4ius, there are three major segments that must be considered, 
School Review, Solution Selection/Development and Solution Implementa- 
tion. We should note that others have used a similar framework. For 
example, Vandenberghe (1982) has suggested a slightly different parti- 
tioning of the latter segments.^ 

■ As the case studies are introduced and described in this paper, the 
framework will be used to organize the various concepts, findings and 

4 

He^ suggests that "the way schools prepare themselves for? the 
adoption" can be called mobilization and that implementation , refers to 
the activities and problems that occur during the first two. years of 
use. 



recommendations. that ate' discussed. In this way we. hope that the reader 
will be able to maintain an overall perspective of the school 
improvigment process while" at the\,same time studying the details of 
particular school improvement efforts. 

The Concerns-Based Perspective of School Improvement 

One perspective for describi/ig and understanding the Improvement 
process is outlipeo in the Concerns Based .Adoption Hodel .(CBAM) wMch 
has been under developibent at the Texas R&D Center. It is this framework 
that has been used in the OeffCo and West 'Palm Beach efforts to guide 
and monitor implementation. In the CB AM Model much attention is given 
to understanding the individual who is learning to use new products and 
procesUs and to describing these "inno'i^ations" 'in ways that can make 
the change/ iftiprovement prdcess more effective anjf personal ize^. 

The concerns-based perspective' can be highlighted ■ by quickly 
reviewing several of the basic assumptions that underline the model. 
The first assumptidn and ong that has received a great deal of attention 
in recent years is that change is a process not an event . New practices 
ahd materials are not simply placed in use by schools and individual 
teachers at a" singular point and time. Rather there is a process of 
familiarization with alternatives, selecting a particular solution and 
then implementing that solution. Thus, in understanding school 
improvement from a concerns-based perspective it is' essential to 
consider school improvement as being a process, not an event. 

Another key assumption\it^ the ©lAM Model is that the change process 
must be understood from the point of view of the many individuals who 
are participants in it. Change cannot simply be viewed in terms of the 
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larger organizational factote or groups or In terms- of the ultimate 
goals of^^he change' V effort, i School Imprevemertt^ Is a proc^^ that' 
teachers, administrators: and others will experience Individually as well 
as collectively. « The Individual inembers of an organization must be 
'cons1der?[d.\, , ' • . . 

, A related assumption Is that for. Individual members Qf .the 
organization there is a personal side to cha'hge . "Personal feelings and 
perceptions must be taken Into account by managers of the change 
process. Further* It Is assumed In the CBAM Modef^at " at the 
Individual level the change . process entails developmental growth In 
feelings about the Innovation and skill In using It. \ 

• ■ * • 

Based upon these assumptions, In 'the Coilcsrns Based Adoption Model 
change facilitators, those administrators and others who have 
responsibility for facilitating change, 'must' "Intervene" In ways that 
are consistent with the developmental levels of the clients (I.e. 
teachers). These Interventions Include workshops, sending memos,' 
consultations In a. hallway and alV other forms of support and/Or 
hindrance that occur during the change process. Thus, It Is possible 
from a concerns-^ased perspective to plan, monitor and facilitate the 
change process across, time by being aware of the developmental state of 
Individuals, subgroups and the entire organization. 

A key to being able to work In these different ways Is to have an 
understanding of the three diagnostic dimensions of the Concerns Based 
Adoptiop Model: 1) Stages of Concern about the Innovation, 2) Levels 
of Use of the Innovation and> 3) Innovation Configurations. Each of 
these diagnostic dimensiohs will be described in some detail in the 
remainder of this section. 
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stages of Concern about the Innovation ' 

To better understand the personal side of the change process the 

researchers at the R&D Center turned to earlier work that had, been done 

., ^ ■ . ■ ■ . - 

around the concept, of "concern^s" by Frances « Fuller (1969). In her 
pioneering work she proposed that student teachers as they move through 

preservlde teacher education programs move through a series of levels or 

" . ■ ■ / 

phases of concerns about teaching. ^' . 

Fuller found that Initially student teachers' concerns were 
completely unrelarted to teaching. They had concerns, but thfey did not 
relate to the topic pf teaching. Their concerns would be about academic 
course wprk oV getting along with their rooirmate or some other non 
teaching related topics. 

The first student teaching related concerns had a self focus to 
them. Preservice teachers had concerns about their own adequacy to 
teach and to control children. They had concerns about getting to and 
from schools and about ^ the evaluations' they would receive from their 
supervising teachers. ^ ' 

As these concerns w|re resolved task concerns became more Intense. 
These are concerns about the management of instruction and the many 
little tasks that are a part of teaching. Ultimately, student 
teachers' concerns about teaching shifted to more Impact related topics. 
These Impact related concerns had to do with how, they could Improve 
their skills as teachers so that learning occurred in their students. 

Based oh their field, notes and clinical experiences the change 
process researchers at Texas hypothesized that the concerns phenomenon 
of student teachers, as described by Fuller, could b^ applied to 
teachers in ser'ice and other* as they were involved In change. Through 
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A series of measurement development activities and subsequent field 
studies it was confirmed that in fact there was a similar dynamic to the 
concerns that practicing teachers and college faculty experience as they 
are involved in change (Hall & Rutherford, 1976). This new formulation 
of concerns was named Stages of Concern labout an Innovation (So(JJ. In 
total, seven d1ffei*ent Stages of Concern have been identifed and 
described. These Stages of Concern about e^n Innovation are summarized 
In Figure 2. , \ 

Assessing Stages of Concern \ 

Three different procedures have been developed for assessing Stages 
of Concern. Two are particularly useful to practitioners and the third 
Is more useful for research and evaluation purposes. All thi^ee wjill be 
highlighted here since all were used in the case studies. The first 
technique for assessing concerns Is through a "one legged conference" 
where the principal, staff developer or other change facilitator carries 
out a one to^ -f ive-minute- conversation with a-teacher, as. they are 
casually walking along (thus, the name — "one legged conferences"). In 
this conversation it Is possible for a trained change facilitator to 
estimate the concerns of the teacher. Of course the change facilitator 
Is then expected to "Intervene," based on his or her diagnosis. 

A more systematic way to assess concerns Is through the use of the 
Open Ended Concerns Statement (Newlove and Hall, 1976). In this format 
teachers are asked to write a paragraph that describes their concerns 
about the school Improvement process, a particular set of curriculum 
materials or whatever the Innovation Is. These written concerns can be 
content analyzed to identify particular topics of concern to teachers 
and also the Stages of Concern that are most intense. This technique 1s 
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Figure 2 

STAGES OF CONCERN ABOUT THE INNOVATION* 
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The focus Is on exploration of more universal benefits from 
the Innovation, Including the oosslblllty of major changes 
or replacement with a more powerful alternative. Indi- 
vidual has .definite Ideas about alternatives to the pro^josed 
or existing form of the Innovation. 

The focus Is on coordination and cooperation with others 
regarding use of the innovation. 

— Attentio^-4o€4i5e*-on-4ffipac-t-0f-^the~1nnovat1m-«n-Ttodent-i^^ 
his/her Immediate sphere of Influence. The focus Is on 
relevance of the Innovation for students, evaluation of 
student outcomes, IncludlnQ^performance and competencies, 
and changes needed to Increase student outcomes. 

Attention is focused on the processes and tasks of using 
the llmovatlon and the best use of Information and resources 
Issues related to efficiency, organizing, managing, sched- 
uling, and time demands are utmost, 

Individual ,1s uncertain about the demands of the Innovation, 
his/her Inadequacy to meet those demands, and his/her role 
with tna Innovation. This Includes analysis of his/her 
role In relation to the reward structure of the organiza- 
tion, decision making, and consideration of potential con^ 
fllcts with «xtf ting structures or personal commitment. 
Financial or status In^H cat Ions of the program for self '«nd 
colleagues may also be reflected. 

A general awareness of the Ifwovatlon and Interest in learn- 
ing more detail about It Is Indicated. The person seems to 
be unworrled about hlmself/hirself In relation to the Inno- 
vation. She/he is Interested In substantive aspects of the 
Innovation In a selfless maimer such as general character--. 
Istlcs, effects, and requlr&nents for use. 

Little concern about or Involvement with the Innovation Is 
Indicated. 



♦Original concept from G. E. Hall, R. C. Wallace. Jr., S W. A. Dossett. A 
Developmental Conceptualization of the Adoption Process within Educational 
Institutions (Austin, Tex.: Research and Development Center for Teacher 
Education, The University of Texas, 1973). 
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particularly useful In prreparatlon Vor interventions such as staff 
meetings and workshops (Hall ftnd Loucks, 1978). 

For a more rigorous assessment of the concerns dynamic the Stages 
of ^Concern Questionnaire has been developed (Hall, George and 
Rutherford, 1979). This is a psychometrically rigorous questionnaire 
that can be used to assess concerns in regard to any educational process 
or product innovation. In the ScC Quest Ipnnailpe there are 35 items to 
which individuals respond using a 7 point Likert scale. This 
' ^questionnal re can then be scored_ .and. a "concerns- ptrof i ie" can_ be 
developed for individual and gfoup interpretation. With the SoC 
Questionnaire it is possible to identify the Stages of Concerns that are 
most intense and also those that are the least intense. A skilled 
interpreter of SoC profiles can tell much about how a pa-ticular change 
effort is developing and about, the perceptions and reactions that 
teachers and others have about it. A sample of the SoC Questionnaire 

« 

Profile is Included as Figure 3. 

Arousal and Resolution of Concerns 

In theory, Stages of Concern represent a developmental progression 
of the Intensity of qpncerns of teachers and others as they move through 
a school improvment process. The hypothetical wave motion of intensity 
of concerns is illustrated in Figure 4. I n1 tally Stages 0 Awareness, 1 
informaiionaT, and 2 Persona V will be more intense. As implementi on 
begins then Stage 3 Management concerns become intense and the Personal 
and Informational concerns begin to drop in intensity. Ultimately the 
earlier Stages of Concerns will become low in intensity and some 
combination of "impact" concerns (Stages 4 Consequence, 5 Collaboration, 
and 6 Refocusing) will become more intense. This hypothesized progres- 




figure 3 
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slon In Intensity of concerns has beeir docuinente^ In several studies* 
however this progression does not necessarily happen In all Instances. 
Clearly, the resolution of earlier concerns depends upon the character- 
Utlcs and qualities of the Innovation, the skill of the change facili- 
tators, the amount of time that the Implementation effort h^s been 
undeniiay, and other contextual factors that may Influence the change 
process. 

^. 

Levels of Use of the Innovation 

The Stages of Concern dimension focuse^ on the feelings and 
perceptions that teachers have about a particular Improvement .effort, 
rt does not tell the Interpreter very much about what the person Is 
actually doing. The second diagnostic dimension of the CBAM model. 
Levels of Use of the Innovation (LoU), addresses this. 

Consonant with the assumption that change Is a process not an event 
Is the understanding that a person Is not one day a non user of an 
Innovation and In the next Instance a highly sophisticated user. The 
user of an Innovation develops skills across different "levels" of use 
of the Innovation. ■ ^ 

In this second diagnostic concept eight different Levels of Use 
have been Identified and described. These are Illustrated In Figure 5. 
There are three non use levels, 0 Non Use, I Orientation and II 
Preparation, and five use levels, LoU III, IVA, IVB, V and VI. Each of 
these Levels of Use has been operationally defined and behavioral 
Indicators have been specified to help a change facilitator or a 
researcher to Identify and differentiate between the levels. 

19 
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Assessing levels of Usj& 

The change facilitator can estimate Levels of Use through a "one 
"legged" conference similar to" that used for Stages of Concern. For 
research purposes a specially developed focused interview procedure is 
used (Loucks, Newlove & Hall, 1976). This.takes the form of a 15 to -25 - 
minute Interview which the interviewee perceives as a conversation .about 
what he or she is doing. The trained LoU interviewer is able to use a 
branching format based on the operational definitions of Levels of Use 
and follow-up probes to identify particular behaviors in which the 
interviewee engages that are indicative of a particular Level of Use. 

The Levels of Use dimension becomes a particularly useful tool for 
planning since it is possible to predict to some degree how the Levels 
of Use will change across time. With this knowledge staff 'development 
and other and resource needs can be anticipated. For 
example 60 to 70% of the first time users of an innovation will likely 
be at a level III Mechanical Use (Hall and Loucks, 1977). This is a 
time when there Ads a short term focus to the user's jJlanning, a rather 
disjointed and Inefficient use of materials, and perhaps constant 
referral to the users manuals. At this time the assistance that is 
needed should take the form of "how to do it" workshops and other kinds 
of consultation that can help resolve inefficiencies. 

As will be illustrated in the Jeff Co and Palm Beach case studies 
monitoring Levels of Use at regular Intervals makes it possible to chart 
the progress of a change effort and to then make mid coursa adjustments. 
Thus, the Levels of Use becomes another important diagnostic and 
monitoring tool for change facilitators, researchers and eva'iuators. 
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Figure 5 
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VATION USE OR ITS CONSEQUENCES. 

Changes use of the Innovation based on fomal or infonwl 
evaluation in order to Increase client outco«ws. 
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Assessing Levels of Use ■■ . , ' . 

The change facilitator can estlmiite Levels of Use through a "one 
legged" conference similar to that used for Stages of Concert. For 
research purposes a specially developed focused Interview procedure^ Is 
used (Loucks, NewTove & Hall, 1976). This takes the form of a 15 to 25 
minute interview which the Interviewee perceives as a conversation about 
what he or she Is doing. The trained LoU interviewer is able to^use a 
branching format baSed on the operational definitions of Levels of Use 
ana follow-up probes to identify particular behaviors in which the 

If 

intiirviewee ensages that are indicative of a particular Level of Use. 

The Levels of Use dimension becomes a- particularly jseful tool for 
planning since it is. possible to. predict to some degree how the Levels 
of Use will change across time. With this knowledge staff developntent 
and other intervention and resource needs can be anticipated. For 
example 60 to 7Q^ of the first time users of an Innovation will likely 
be at a level III Mechanical Use (Hall and Loutks, 1977). This is a 
time when there is a short term focus to the user's planning, a rather 
disjointed and inefficient . use of materials, and perhaps constant 
referral to the users manuals. At this time the assistance that is 
needed should take the form of "how to do it" workshops and other kinds 
of consultation that can help resolve Inefficiencies. 

As will be Illustrated In the Jeff Co and Palm Beach case studies 
monitoring Levels of Use at regular Intervals makes It possible to chart 
the progress of a change effort and to then make mid course adjustments. 
Thus, the Levels of Use becomes another Important diagnostic and 
monitoring tool for change facilitators, researchers and evaluators. 
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InrfDvatlon Configurations 

The third diagnostic dimension of' the C6AM Model focuses on 
describing In operational ways the Innovation as it Is imp1einen;(ed by 
different users. As Is frequently recognized different 'users adapt 
Inndviitfons In different ways (Bemjan & McLaughlin, ,1978; Blakely, 
1982). This resuUs In different "configurations" of the innovation 
(Hall and Loucks, 1981). Frequently inany different operational forms of. 
an Innovation can be found within^ the same school. In some Ifistances' 
the developers model .or vision of the innovation is quite different from, 
the configurations that are found In class ro6ms.. Thus, the third' 
diagnostic tool for change facilitators, researchers and evaluators 
makes It possible to systematically describe tiie configuration of an 
Innovation as It Is Implemented by different users. 

To do this a special procedure has been developed to describe the 
operational form. of an Innovation (Heck, Stieglebauer, Hall and Loucks, 
1981). This procedure entails the reviewing of all the materials and 
descriptions that, are available about the innovation, then meeting with 
the various developers and observing classrooms where the Innovation Is 
In use. Out of these steps It Is possible to Identify the Components 
that make up a particular Innovation. These components can then be 
arranged In a Configuration Component Checklist which can be completed 
by teachers, a<bn1n1strators, staff developers or others who are 
Interested In describing and differentiating the different 
configurations of an Innovation that occur In different classrooms. A 
sample of a Configuration Component Checklist is Included as figure 6. 

A developer, as referred to above, is an individual or group of 
individuals that "develop" an innovation. The developers may be frcNn an 




Cofiiponcnt I: Objectives 



(1) 

Teaches Resource 
Guide objectives 
In their sequence 



(2) 

Teaches text 
oiijtetlves 



(3) 

Teaches other 
objectives 



Component IT « Instructional Resources 



(1) 

PrIiMirlly uses 
activity kits 



(2) (3) 

Primarily uses Primarily other 

teacher generated connerclal materials 
materials 



Component III; Testing ! 

. (1) I 
Primarily mastery 

test at recomnended 

time I 



' (4) 
Primarily uses text 



(2) 

Primarily uses 
textbook tests 



(3) 

Primarily teacher 
made t^^st 



(4) 

Primarily teacher 

observation/ 

Judgement 



Component IV»*Group1n<l 
(1) 

Individualized 



(2) 

3 or more small 
frequently 
changing groups 



(3) 

3 or more small 
stable seldom 
changing groups 



(4) 

2 groups at generally 
same objectives 



(5) 

Whole Class at 
generally same 
objective 



Com ponent ^' Use of Test Results 



(1) 

Each student's 
instruction Is 
Individualized 
on basis of. test 
results 



Groupjsl change; 
students are 
reassigned 
frequently 



Group(s) remain 
Intact*, students 
receive extra 
help as needed 



, (4) 

Group(s} remain Intact 
any review Is done by 
group 



Component VI: Record Keep In 

(1) . 
Class profile 



displayed and 
<^ current Information 
fctvl^ recorded 



(2) 

Class prpflle 
displayed, 
but not current 



(3) 

CUss profile not 
on display 
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outside agency, such as a national currlculuriL^roject*' or publishing 
company. Developers can al>o be teachers and others from a. particular 
school. In* the Innovation Configuration Mork no assumptions are made- 

* * * * 

about who the developer is and where they are- "located." 'It is 
important that the developers describe their innovation in operational 
terms. If- the "deveTopers" are the entire staff of a school then the 
staff of the school 'should b^ .^he ones to develop the Configuration 
Component Checklist. If the developers are publishers, then they should 
be consulted. Without some Indications about what the innovation is 
suppos|,d to be like in operation, it is very difficult for. teachers and 
Others to know what to do or how how much freedom they 'have to vary 
their innovation use. ^ 

A related, discussion point has to do with the issue of fidelity; of 
implementation. In developing a Configuration Component Checklist,; it 
is not necessary to build in a fidelity perspective. But the process 
does force the participants in a change effort to consider to what 
degree fidelity is important to them. Their decisions can be reflected 
on the. Components Checklist. This information then becomes available to 
all parti cipanis. In this way when fidelity is important teachers , lean 
be given clear ^expectations about which configurations of an innovation 
are "acceptable" and which are "unacceptable." 

The Innovation Configuration concepts were applied in the two case 
studies to be described in the next' sections of this paper. In the 
Jeff Co case a fairly clear, consistent and strongly held stateir^nt aboul 
acceptable practices was a part of the implementation effort from, the 
very beginning. In the Palm Beach case the ciiterion for minimum 
acceptable practice was le^s ambitioMS and tended to evolve with the 
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impUmentatlon process. These two different perspectives on fidelity 
had some important consequences for Implementation success In the two 
districts. Some of these Issues are discussed In the sumnary section of 
this paper. , 



Interventions - — — " 

A brief mention needs to be made here of the concept ot 
Interventions. Another part of the Texas research has focused on 
•developing an. Intervention Taxonwny (Hall, Zigcrml and Hord, 1979; 
Hall and Hord, a2) and procedures for analyzing ahd labeling the 
different k^nds of Interventions that occur during a change effort. In 
general any actton on event that Influences use of the innovation Is 
considered an Intervention. Examples of Interventions Include sending 
memos, telephone calls, conversations In the hallway, workshops, and 
policy decisions. 

More recent work at the Texas R&D Center Is focused on documenting 
the Interventions that various change ^^facilitators such as principals 
make as an TmpT(Bmentatron^^~e^^ 1980). 
Work is also focusing on developing training resources (Hord, Thurber, 
Hall, 1981i.Hord and Thurber, 1982) that can be used in helping school 
leaders become more aware of the kinds of interventions that they make 
and the effects that these various interventions |iave. • 

This work will not be described in further detail in this paper, 
however the concept of interventions is one thajj^ill * P*'^^ 
cases that are described. Different in^rventions were made at 
different times depending on t^e StageS^^fU&rtcern, Levels of Use, and 
the Configurations of' the Innovation that were being Implemented. 
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Interventions In a Concerns Based model are provided to address the 
needs and practices, of the non users, and users of innovations. That Is, 
Interventions are grounded 'in the participants school Improvement 
experiences as they are occurring. One way to depict this relationship 
Is Illustrated In Figure 7. 

The School Improvement Process and CBAM • 

At this point a bVlef return to the organizing framework that was 
presented In Figure 1 may be helpful. In a school Improvement effort 
there are three different phases: School Review, Solution 
Selection/Development and Solution Implementation. The three diagnostic 
dimensions of the CBAM model, Stages of Concern, Levels of Use and 
Innovation Configurations are generic concepts. The concepts could be 
applied to any kind of Innovation ano can be used with "non users" as 
well as users. 

; Thus, the CBAM diagnostic dimensions could be used with individuals 
In a faculty as they engage In the "Innovation" of School Review, or 
Soliltion Selection/Development or Solution Implementation. . Teachers and 



others will have Concerns about and levels of use of particular 
confli gyrations of each of these innovations In which they are Involved. 
The OeffCo and Palm Beach efforts used the CBAt^ diagnostic dimensions in 

I ' .- 

I 

the Solution Implementation phase. By having two cases that report on 
the iame phase of the school improvmnt process it Is hoped that the 



reade 



r will be able to more easily draw comparisons and Identify the 



slniilarities and implications that came out of these experiences. 
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Ci$f b— SCHOOL 4HPR0V£HENT^m : 

JEFFERSON COUNTY • COLORADO 

This part of the paper describes an extensive school Improvefnent project 

n ... 

that Included 80 elementary scho&ls, that began In 1974 and continues to^thls 
day. In addition to Involving a major collaborative relationship between the 
University of Texas and th;e Jefferson County Public Schools, the project also 
Involved the support of a third Institution, the Math artd Science Teaching 
Center at the University of Wyoming. The improvonent project began with a 
needs assessment conducted In 1973 and progressed through the development of a 
.revised elementary science program for grades 3 through 6 that was Introduced 
to all elementary schools In the district. The Improvement effprt was 
supported through an extensively planned staff development program that was 
monitored using the Concerns Based Adoption Model Instruments, Stages of 
Concern Questionnaire and Levels of Use Interviews. Following the 
Implementation of the revised program In all schools, the degree to which the 
program had been successfully Implemented was monitored 1n randomly selected 
-schools ns^tng— 4— locall y develope d— conf4gurat4o^-^heckVt^"iMs^"^a1- 
monitoring effort proved so successful that the entire school district adopted 
the model for Implementation developed by the Science Oer)artment. 

* 

< 

School Review and Curriculum Development In 

Jefferson County Public Schools iJeffCoT 

^ - ^ 

Jeff Co was created in 1951 by the consolidation of 39 separate school 
districts and the establishment of a dlstrlct^wlde uniform curriculum policy 
in order to unify the various communities and school differences. Today 
curriculum continues to be developed through a well defined process that was 
formalized In 1974 (Jefferson County PMbllc Schools, 1974). This process 
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fncTudes a school review and needs assessment, the development of objectives, 

9 

curriculum writing, pilot testing, field testing and district-wide 
implementation, support and maintenance. . ^ 

There are several groups that provide advisory recornnendatlons to the 
curriculum developers throughout the process, and ultimately advise the Board 
of Education whether the program should be adopted or not. These groups 
Include lay/professional curriculum counclU, principals and district school 
Improvement project council, and the superintendent's cabinet. When the 
curriculum development process Is completed, assurances have been made that 
all of these groups support, the curriculum modification and that budgetary 
support and personnel time allocations have been made, both for the 
development and the Initial Implementation activities. In Jefferson County 
individual school improvement^ In the area of curriculum 'modi float Ion, takes 
place within the context of a district wide umbrella. That support, which Is 
both technical and financial, makes significant and extensive change or 
Improvement possible that would generally be Impossible for an Individual 
school operating alone. 

The entire process begins with a needs assessment which can be conducted, 
or presented by any number of groups. Including program coordinators, parents. 
Individual teachers, prl^lpals, etc. Once the needs assessment Is carefully 
documented It Is presented to the advisory groups listed above. If concensus 
1s reached by these groups, the job of developing the objectives and outline 
for the curriculum Is assigned to a curriculum coordinator, who will pull 
together a committee of teachers, administrators, and often parents, to 
develop objectives of the new course or unit. 

The objectives are reviewed by the reconmending groups. A writing team 
will then be assembled to create a pilot version of the unit or course. The 



material Is piloted In a few selected schools by teachers (often some of the 
writers) Mho are very familiar with It. These highly qualified pilot teachers 
allow the curriculum developer to hold the quality and experience of teachers 
constant and examine the variable of the materials. The feedback collected 
from the pilot teachers Is thiin presented to the above groups and^ If- 
permission Is granted, a field test version of the unit Is developed. The 
sample of field test teachers Will be a much, more broadly selected group, 
usually randomly selected from a variety of teaching situations throughout the 
district. The purpose of the field test Is to determine the management and 
Implementation problems that typical teachers encounter with new materials and 
design the Inservlce and other Implementation activities so that the 
curriculum will be used by the rest of the teachers In the district. 

One last round of approval must be obtained from the groups noted above 
and then the plan and Curriculum are presented to the Boarci of Education for 
their, approval. By this time, teachers and administrators across the entire 
district are well aware of the Impending change even though ^they have not all 
been directly Involved with the change effort. With this surmary as back- 
ground, most of the balance of this section of the paper will describe the 
Implementation activities used to help all teachers to Incorporate the revised 
science program Into their teaching. 

The Innovation - Revised Elementary Science Program^ Grades 3-6 

The elementary science program In use prior to the revisions had been 
Implemented In 1969. By 1973 a lack of attention to science, due largly to a 
major emphasis on teaching the basic skills, had created several problems that 
were Identified In the 1.973 review of the schools and needs assessment. The 
needs that were Identified at that time were: 
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1. New district goals and student outcome statements had been adopted to 
describe what the "Jeff Co coirmunlty thinks a graduate of our schools should 
look like, act like, and be prepared to do when he leaves high school." 
(Jefferson County Public Schools, 1974). The curriculum needed to be modified 
to meet these goals. ' 

2. The orginal program was weak in the area of life science. Teacher 
observation and research (Whitla, 1973, BSCS, 1975) Indicated that students • 
were very interested in themselves and their physical, biological and social 
environment. With this knowledge the decision was made to strengthen the 
health and environment education areas of tlie curriculum. 

3. The "back to basics" movement, with its strong eniphasis on reading, 
mathematics and language arts, reduced the time and effort given to science in 
many schools. In order to, promote better learning and maximum instructional 
time, specific application and reinforcement of identified basic skill 
objectives would be Incorporated, into science activities. 

4. A more precise definition of expectations was needed to help teachers 
better understand open-ended science activities* This would be a set of 
performance objectives which clearly defined expectations of students, as well 
as processes of measuring and assessing student performance. 

With these needs identified, the formal district curriculum development 

process was initiated. By 1975 lists of objectives and assessments, as well 

as references to basic skill objectives were' produced for each science 

teaching unit. In adaition a carefully designed Teachers Guide was developed 

for each grade level. This guide consists of a notebook that acts as a 

s 

"roadmap" through the commerical science curriculum materials that are used 
and outlines thi» activities that teachers are to use. These guides also show 
where teachers may supplement with outdoor activities, identify what media 
win reinforce concepts, suggest how to evaluate students ana include a 
complete set of worksheets. The total program, grades 3-6, is delineated in 
four content strands: health, physical science, environmental sciences, and 
earth science/astronoiny. The activities place an «nphas1s on hands on 
experiences, inquiry learning and cooperative student work. * 
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Assumption #1; Change is a Process— Not an Event 

The Jeff Co Science Department had scheduled a fairly typical three<-day 
Inservlce activity for teachers very near the beginning of the school year. 
After considering the CBAM model Ideas, that plan was changed to allow morf 
time between sessions for teachers to use the units In their own classrooms. 
Since the Inservlce plan for any one school would now require almost a year to 
complete, the 80 elementary schools In the district were divided Into three 
groups or phases. Phase II and Phase III schools began their Inservlce 
program six months and one year, respectively, after Phase I. 

Other activities were arranged to .extend the time In which teachers would 
have to adjust, to change. A series of two pre-lnservlce sessions were 
scheduled approximately two months before the Inservlce sessions were to 
begin, to Introduce teachers to the new program. Approximately three months 
prior to that, all principals of the. _s5hQo]jL_jLDjfolved. parl^^^^ 
one-half day orientation to the revUed program. Ways In which they could 
Inform teachers of the change and support the change process Itself were 
outlined. Then after the final Inservlce sessions were completed, contact 
with teachers was maintained through a planned series of "comfort and caring" 
visitations by two menders of the Science Department to the classrooms 
Involved. The "change process" was given two years Instead of two weeks. 

Assumption #2: Change Is a Personal Experience 

The Inservlce plan called for paying close attention to the Individual 
teachers who bear the ultimate responsblllty In lir^lementlng the new program. 
Principals were given suggestions for personally supporting their teachers 
through scheduling procedures, provision of e(|u1pment and supplies and simply 
providing time to discuss the Innovation. 
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The Implementation: A Conaborative Effort 

When the collaboration between Jeff Co and the Texas R&D Center began In 
the spring of 1976 the development process of the revised program had been 
completed and had been approved for Implementation. , The science program 
developers and the sttfff development office had completed the initial plans 
for an extensive implementation Inservice program to be conducted over the 
next two years. 

As the R&D researchers and the Jeff Co practitioners began their Joint 
planning effort, the concept of Levels of Use served as an important goal- 
setting function for the Jeff Co troplementation. The goal established was that 
each teacher would reach at least a Routine (IVA) Level of Use. This decision 
influenced the target teacher population, the kind of support provided and the 
structure of inservice for teachers. 



In addition to this Level of Use goal, it was determined beforehand that 
the 1(1^1 ementat ion effort should result in low Informational, Personal and 
Management concerns (Stages 1-3) by the end of the in^lementation effort. It 
was hoped that resolving these would allow concerns about students or impact 
concerns (Sta^e 4) to dominate science instruction. 

To carry out the impler(|entat1on the first activity was to plan with and 
train 23 carefully selected elementary teachers who would serve as inservice 
leaders (An additional 11 leader^ were prepared during the second summer). 
Their training session took place at the University of Wyoming Hath and 
Science teaching CenUr and lasted for a full week. With the assistance and 
input of the R&D staff and the University of Wyoming staff, the Jeff Co 
inservice leader teachers used the CBAM inodel to rework the inservice and 
Implementation plans. In developing these plans thf following assumptions of 
the CBAM model were used as a guide. 
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The pre-tfiservlce sessions were held In eac|) of the local schools. The 
ses^ons were Informal an^ Included a small number of teachers so Individual 
questions and concerns could te attended to readily. 

The day long Inservlce sessions were designed so that teachers had 
choices of activities depending upsn the amount of science teaching experience 
and confidence they had with elementary science. Teacher-to-leader ratio was 
kept small In the Inservlce sessions, usltig trained, enthusiastic classroom 
teachers who as leaders, had ftl ready taught the new curriculum. These leaders 
could often anticipate, and more readily. Identify with, the problems and 
questions of the classroom teachers than could the program designers. 

Between each of the day-long Inservlce sessions two of the science staff 
members began the comfort and caring activities by consulting ml th and helping 
Individual teachers deal with problems they were encountering with the. new 
•program ■•- ■ " 

Assumption #3: Change Involves Growth in Feelings and Skills 

As mentioned above, individuals go through stages in their concerns about 

» 

an innovation. The pattern is to some degree' predictable and in^lementation 
activities can be planned in general to match the 4evelppment of the 
individuals involved. Because the Jeff Co science implantation plan was 
designed with the Stgges of Concern in mind, it is useful to review the 
chronology of the impl«nentat1on plan according to the stages. 

Stages 0 and 1; Awareness and Informational Concerns. Teachers and 
principals were Informed by a memo from the Science Department in early spring 
that they would be involved in pre-inservlce sessions late the next fall and 
inservlce sessions starting in January the following year. They were told 
which units could be replaced or revised, what equipment would be provided to 
each school and given ia recommended schedule by which they could phase out the 



old guide and teach the units In the new guide to correspond to the inser44ce 
schedule. After the principals' orientation In August, the teachers were 
Informed again by their principal, when they returned to school In September, 
of the pre-inservlce dates and Inservlce schedule. 

Stages 1 and 2; Informational and Personal Concerns. The pre-inservlce 
was specifically designed to Introduce teachers to the reasons for the 
revision, to a few details about the guide and to inform them of the dates, 
location and organization of the total Inservlce plan. A slide tape show was 
used to orient them to the new program, gtiides were distributed to all 
teachers and a brief activity we^s used tp Introduce Its contents and format. 
A small. Informal group setting allowed ampTe time for questions and answers 
about the. entire program. In Addition, teachers were reminded of the 
reconmended teaching schedule that would be most useful to them so that they 
toutrl coordinate their teaching of-the old program and make the transition to 
the new with the advent of the Inservlce sessions. 

At the inservlce sessions Personal concerns were addressed by keeping 
group sizes small so that discussion could occur and |by requesting written 
feedback at the end of each session. As mentioned earlier. Personal concerns 
were lattended to throughout the entire implementation process by means of 
comfort and caring sessions In the local schools. 

Stage 3: Management Concerns. The first Inservlce session paid 
particular attention Management concerns. In an early part of the session 
specific classroom and equipment mangement techniques were explained and 
demonstrated to the teachers. The major portion of the day was spent by 
teachers actually doing the activities in the science units with a strong 
emphasis on "how to do It" by the leaders. A portion of the Inservlce day was 
devoted to self-paced instructional modules. One of the modules from which 
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teachers could select Mas designed to help with mangement techniques for 
caring for live animals In the classroom while another was devoted to 
procedures for conducting outdoor activities. Trained teachers as Inservlce 
leaders meant that answers to many questions were available from people with 
previous classroom experience in that unit. In the next two inservlce 
sessions mangement help was continued but to a somewhat lesser degree as the 
emphasis shifted toward responses to concerns at higher levels. 

■S^»9^ — Consequence Concerns. As expected, the teachers at the 
inservlce sessions varied considerably in their experience, confidence and 
Stage of Concern. To deal with thesi individual differences teachers were 
given a charge to self-select the amount of time they spent actualTy doing a 
unit, giving them more time to deal with Management concerns if they wished. 
They were also allowed a choice during the module sessions, ff their concerns 
had progressed to a Consequence stage, modules on Piaget, qu ,,t1oning 
techniques, such as "wait time," and the use or misuse of science vocabulary 
were availafile. ' 

Monitoring the Implementation 

During the course of the Implementation effort three methodologies were 
used to assess its effects. Stage of Concern and Levels of Use data were 
collected five times during the thrfee-year implementation. The third 
methodology, developed from the concept of Innovation Configuration by the 
Science Department and the district's evaluators, identified program specific 
components and used these components as the basis for measuring the extent of 
inylementation in another set of randomly selfc ted schools. A sample of ig 
schools was selected to represent different phases of implementation. All 
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STAGES OF CONCERN AND' LEVELS OF USE DATA FOR PHASE I SCHOOLS 
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teachers of grades 3 through 6 Mere included Initi ally and^ these same teachers 
were followed through the final year. 

How did the concerns of teachers about ^the revised science program change 
over time? Figure 8 presents concerns data for thie teachers. The first 
measure of concern was collected approximately two montl^s before any inservice 
acti^ties. Notice the concerns were highest at the loW^r stages SoC 0, 1 and 
2. This is typical of non-users. The next data were collected shortly after, 
the second of the three inservice training days had been conducted and after 
taachers had been using the new program for approxioiately four months* Stages 
0 through 3 have dropped in intensity with an increase in refocusing (SoC 6) 
concerns. This general trend with some slight increase in consequence 
concerns plus the lowering of mangement concerns continues through another 
year. The bottom cf Figure 8 displays LoU data from all teachers from all 19 
schools. "Note that these teachers shifted predomineintly from LoU II 
Preparation at the first data collection point to LoU III Mechanical use, 
after three or four months of using the new program. One year after the 
introduction of the program, mechanical users begin to shift to users at 
Routine and higher levels. A year later there are ftill a significant nunoer 
of teachers at LoU III Mechanical use, but at the/last data collection point 
two and one-half years after initial inservice^ a majority are at Routine 
level, LoU IVA. 

It' is interesting to note that with all the contextual} changes and 
competing ^demands on. OeffCo teachers during the implementation years that 
approximately two-thirds of them remained at a Routine level of use and had 
resolved most of their lower stages, of concern. Thus, three years after 
initiating the Implementation effort, the, goals of the facilitators had been 
achieved for most teachers. 

» 
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Monitoring impletnentatlon In Terms of Program Specific Components , The 
program developers/ Implementors welcomed Levels of Use assessment as useful In 
monitoring the early progress of the Implementation effort. A teacher had to 
utilize the district's teachers guide and teach at least 80% of the science 
units to be considered a "user" of the new program. Since there could be many 
ways a teacher could implement the strategies found In the guide, the 
developers saw a need for an expanded definition of use to Include . other 
components that allowed developers, principals and teachers greater diagnostic 
power. This definition nee(led to be In terms unique and specific to the total 
science program. Twelve components of the elementary science program were 
identified and described in their ideal form. They clustered in three 
categories. These components and categories are described in Figure 9. 

Instrumentation and Data Collection . Once the program components were 
defined, detailed descriptions of each were written in order to measure as 
objectively as possible the extent to which «ach component was being 
operational 1 zed by the individual teacher. The behaviors were placed on a 
5-po1nt Likert scale: 1— outside the intended program; 2-3— getting a good 
start; 4— well on the way; 5— best practices in operation. 

'Instruments and data recording sheets for use in monitoring the extent of 
Implementation of the program as defined by the twelve components were 
developed by the district Department of Evaluation (Darnell, 1979). These 
included a focused teacher interview, a classroom observation checklist, a 
focused principal Interview and a focused media siJecialist Interview. 

This assessment of Implementation took place during the second year of 
Implementation after the Inservice program had been completed. A random 
sample of eleven large, middle-size and smaller schools was used. Two hundred 
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Figure 9 
COMPONENTS OP TIC SCIENCE MO^IUN 
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sevent^y-nlne classroom observations were made of 92 teachers and 3,114 
district students. 

Each classroom was assessed on every component and data were summarized 
for each teacher across Interviews and observations. A building summary was 
constructed. Figure 10 represents an example of a building summary sheet. 

Because the components represented an operational definition of a well. 
Implemented elementary science program, it was assumed that the results of the 
monitoring of these components would be used by the principals to Improve the 
program in their building when deficiencies were identified. However'; when the 
data were presented to principals and they were encouraged to use it in a 
follow-up activity with their staffs, they expressed little Interest in doing 
so. Four major reasons for the lack of follow-up seemed apparent: 

1. The principals and teachers had little or no knowledge of. the 
components or the specific behaviors for each component that were 
being used as the basis for the evaluation. 

2. The schools had been chosen randomly^ principals had not elected 
to participate in the program for the purpose of improving the 
implementation of the science program. 

3. Principals had virtually no role in collecting, suitmarizing or 
reporting the data to their staffs. 

4. Teachers were guaranteed anonymity; therefore, no data v^ere linked to 
individual teachers. Since data were summaried for the total school 
only, it was not possible to consider Individual teacher needs. 

The conditions cited above had purposely been maintained by the Science 
and Evaluation Departments in order to collect "clean" data in an unobtrusive 
way. The purpose was to determine the extent to which the program had been 
implemented but not to affect the implementation in any way. 

The second round of evaluation in 1979-80 in a second group of schools 
was based on a more purposeful effort to improve the implementation of the 
program, rather than evaluate the extent of implementation at any one given 
time. To do so the principals became a part of the process (Melle & Darnell. 
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1980). Thus, before school begjin in the fall of the 19^9-80 school year, ten 
volunteer principals became Involved In the monitoring process and attended a 
two>day workshop presented by the program developers. This workshop provided 
small group Interactive practice In understanding 1) the nature of the 
elementary science program, grades 3-6, as defined by the components, 2) the 
facilitating strategies for principals use listed In the "Principal's 
Handbook" for implementing the program, and 3) the classroom observation and 
focused interview techniques used to obtain data. 

Principals presented the components and the process of data gathering to 
be used to their respective staffs. With administrators, program deve:iopers 
and teachers all aware of the components and the process of monitoring, 
principals and program developers began collecting data shortly after school 
began. 

The data from the second group of schools that were monitored revealed 
that the level of component implementation increased dramatically when 
principals were Involved in the monitoring process from the beginning, when 
the component information was shared with staffs before the program was 
monitored, and when the summarized data and results were shared on a 
om ^e basis with each teacher Involved. This is evident in the higher 
ratli^^s of the second group of schools on all components when compared to the 
ratings of the first group of schools. During the second monitoring effort, 
the role of program developer became one of support and as a source of 
expertise to the building administrator. They worked together with a mutual 
goal of aiding staff in understanding the components, implementing the program 
in terms of the components and collecting, sumnarizing and sharing individual 
and total staff data. Teachers, knowing the component goals, modified their 
teaching practices and demonstrated willingness to change behaviors when the 
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principals set goals. This process most certa inly appeared to improve 
Instruction. 

Impact on District Policy 

It is useful , to examine the Interplay between the entire school district 
improvement, effort related to the elementary science program, and the 
activities for improving implementation at the local level just described,, 
the original innovation was a revised elementary science program. The initial 
implementation ef fen was orchestrated across the district by the program 
developers and staff development personnel. Once the initial implementation 
was completed, local school initiative In cooperation with district level 
personnel provided further refinement and Improvement in the use of the 
science program. Although a general scheme was provided, individual schools 
made the decision to participate and to a large extent determined h3w they 
went about it, and what Improvement was needed in their school. It is an 
excellent example of a cooperative effort between local school personnel and 
district based technical staff. 

The interaction and product went one step further when the Science 
Department presented to the Division of Instruction, and eventually the Board 
of Education, the process of improvement just described. After considerable 
study, work and revision, a district-wide policy for the development. 
Implementation and maintenance of programs was approved by the Board cf 
Education in the fall of 1980 (Jefferson County Public Schools, Policy 1MB), 
By this action the school board sanctioned school Improvement at the local 
level with support and encouragement from district based personnel. 
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Evaluating Student Achievement 

In addition to the extensive monitoring of the degree of implementation 
by the use of SoC Questionnaire and LoU interviews and program configuration, 
the program developers developed a criterion reference test for all sixth 
grade students. Development of this test had been proposed by the developers 
at the time the original curriculum revision Mas approved, but it was argued 
that the use of such a test should not be initiated until after the 
Implementation was well accomplishefd in the schools. 

To develop such a test, parallel Items were developed in two batteries. 
The first battery was a hands-on, interview type test that was administered on 
a one-on-one basis. The second battery consisted of a paper and pencil 
multiple choice item type test that matched the items in the first battery. 
Through the extensive help of the University of Colorado Bureau of Educational 
Field Services these two tests were statistically examined and only those 
paper and pencil test items were selected that proved to have a high 
correlation with the" hands-on version^ This test was administered in a field 
test version and finally developed for use for all students. 

In examining the data from the test when used by all three phases of 

* ■ - • - ^ 

Implementation almost three years after the first inservice program began, 
there was evidence that at least the better students in Phase I scored higher 
on the criterion reference test than those in the other two phases. (Pratt, 
Winters and George, 1980) The most straight forward interpreUtlon of these 
results is that teachers with greater experience with the new science program 
were more effective with students of high ability. The conclusion rests on 
the assumption that Phase I teachers are implementing the program more fully 
than Prtase II or Phase III teachers. It is true, from the earlier data, that 
Phase I teachers had higher Levels of Use at the time of the testing than 
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Phase II or Phase III teachers, (Loucks & Melle, 1980) that Is, more years of 
experience In the use of the program by teachers leads to higher Levels of Use 
which In turn leads to higher achievement by th61r students. 
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Case 11: PALM BEACH COUNTY, FLORIDA y 
SCHOOL IMPROVEMENT EFFORT 

The school sviitem of Palm Beach County, Florida serves 72,000 students. 
It Is made up of 96 school centers: 59 elementary schools (primarily grades 
K-5 or 6), 17 middle and junior high schools, 14 senior high schools, and 3 
special education centers Including 3 vocational /technical school centers 
serving high school and adult clientele. There are over 8,000 employees In 
the system which Includes approximately 4,500 teachers. The school district' 
has had for several years a strong school -focused staff development program. 

In 1978, the Palm Beach County Schools Inaugurated and continues to be 
Involved In a system-wide process designed to bring about school Improvement. 
The outcomes of the process were expected to be Increased student perfprmance 
In four basic areas of learning: 

" mathematics 

- language arts (Including reading and writing) 

- social sciences 

- inatural and physical sciences 

The school Improvement effort centers around the development and 
Impleroentatlon of an Innovation known as the Palm Beach County Unified 
Curriculum. The Unified Curriculum Is a district developed program with the 
following components: sequential Instructional objectives, suggested 
Instructional activities and materials; student mastery tests; individual 
student progress records; class profile record keeping charts; and other 
resource materials to be used as appropriate in the Instructional process. 
The system-wide use of identical textbooks supports the instructional process. 
The Unified Curriculum program, which has as its aim the provision of a 



consistent Instructional program for all students was Initiated Vo respond to 
two system-wide needs: 

- poor pupil performance on cognitive test measures 

- high rate of pupils transferring among schools because of family 
mobility. 

0 * 

Weeds Assessment 

,The first problem addressed by the utilization of the Unified Curriculum 
was poor student performance. On the state-wide testing program (the Florida 
State Student Assessment Test which Is administered at selected grade levels) 
the system-wide results were quite low. For example, In the area of mathe- 
matics, third grade students scored at or above the state-wide average on only 
1 of the 14 stand;irds assessed and fifth graders did not score at or above a 

single standard, ' ■ 

\ 

Second, the students of the Palm. Beach County Schools are an. extremely 
mobile group. Approximately 40% of them transfer from one school center to 
another (other than vertical articulation) within their careers as K-12 
pupils. Prior to Introduction of the Unified Curriculum, students 
transferring from one school to another within the district were most likely 
to- find themselves in a completely different set of text materials in a vastly 
changed instructional program. This was usually the case though pupils were 
transferring to the same subject within the same grade, level. The disruption 
to student progress in such a context is obvious. 

Improvement Effort: The Game Plan 

For the miajor reasons cited, the School Board of Palm Beach County and 
the decision-making administrators of the system set an important course for 
school improvement focuseo on instructional programs. The curriculum area of 
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elementary mathematics was given the first attention for improvement.. This 
effort which Is now entering Its fourth year evolved along several, 
interrelated lines: 
Program 

Development and revisipn of curriculum objectives and n^terials : 

Administrative personnel 

Preparation of school center and other administrators and 
facilitators to support the change effoRt 
... training in how to deal with the change process " 
... training In the content of the curriculum materials 

Instructional personnel , - ^ 

Development of teachers' skills to utilize the new program and 

materials . , 

... training through centralized and school focused ^forts 

... training through school -based efforts ' . 

' ' 4 

V 

* 4 

% ■ ■ • 

The New Program 

The process for development of the Unified Curriculum Involved all levels 
of local school district personnel. Teams of teachers developed listings of 
objectives for each elementary grade level, and for secondary level 
mathematics courses. Writing teams comprised of teachers organized and 
revised the objectives. These objectives were then sent to all teachers who 
were asked to examine the objectives In terms of their adequacy, regarding 
appropriateness for i^rade level, relationship td subject, and degree of 
difficulty. Teachers' remarks about the objectives were then collected. The 
teacher writlhg teams, under the direction of a central curriculum development 
specialist, utilized the objectives as revised by teachers in the field to 
initiate the development of Resource Guides. 
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•'The Resource Guides contain the objectives arranged In an appropriate 
sequence and, also, suggested Instructional activities for classroom use. The 
writing teams developed student Mastery Tests which test each objective, and 
various Indlyloual student and group record keeping forms. The materials 
Including all necessary graphics were produced and printed locally. As the 
materials were being developed they were reviewed formatlvely. t)y selected 
groups of teachers. As , the teachers tested the materials they returned their 
Opinions on forms provided^ Feedback meetings InvoTvifig teachers and 
administrators were also conducted. 



Personnel; Implementation/Facilitation Training 

An equally significant effort was devoted to the Implementation process, 
for without successful Implementation the expenditure of financial and human 
resources In the development effort would be of no avail. Concurrent with the 

initiation of the development process for the Unified Curriculum an effort was 

\ 

undertaken by Instructional division personnel to acquire Information that 
would assist and support the Implementation of thef materials. 

As a result, central office personnel ^-etfrned of research, relative to 
understanding Individual respqa sis during the change process, being conducted 
by the Research and Development Center for Teacher Education at The University 
of Texas, Austin. More specifically, local Interest centered on how knowledge 
of and training In two of the CBAM (Concerns-Based Adoption Model) diagnostic 
dimensions, the Stages Of Concern- (SoC) and Levels of Use (LoU) concepts^ 
could assist admlnlistrators In Implementing an educational innovation. The 
concerns-based approach to curriculum implementation being utilized by science 
coordinators (and trained teachers who served as inservlce leaders) at 
Jefferson County, Colorado, was studied in detail, including on-site visits by 
teams of Palm Beach administrators and curriculum developers. Noting the 



success of the Jefferson ^County pisogram,; the Palm Beach District elected to 
J utilize a concerns-based apj^roach to Implementing the Ur^lfled Curriculum. 

Central A<te>ln1strators;^ As the curriculum materials neared their. 



publication, the first phase \f the implementation Inservlce for ■facilitation 
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began. Central and other non<^chool . administrators (external facilitators, 
such as sub-district area math specialists) Mere oriented to their role In the 
change process. Relevant f1nd1rigs\from the Rand Change Agent Study (Berman & 
McLaughlin, 1978) and the CBAM work were Incorporated into the training 
provided to administrators, which focused on the various factors deemed 
important to successful program imnlementatlon. External facilitators 
Involved In the training for district administrators Included several Florida 
Atlantic University professors, one of whom provided metric workshops to some 
schools and another who helped other schools develop supplen^ntal materials. 
Following the initial sessions for the central administrators, the Inservlce 
program for the building level administrators began. • 

Training for principals. It Is a couinonly held view that the principal 
(headmaster) Is the key to the Implementation effort. Therefore, the training 

of the principal was considered 'io be critical ^or the Palm Beach school 

■ — 

improvement goals. / The CBAM concepts and skills, a major focus In the 
training, were considered to be as Important for the principal as was the 
content of the Resource Guides. The design of the training of the principals 
W5S conducted using a concerns-based approach (riord, Thurber, Hall, 1980; Hord 
& Thurber. 1982). During the first phase, the training focus was on Stages of 
Concern and howHo use this concept to.^elp teachers. DUrIng the first 
session, all principals were taught how to Identify Stages of Concern using 
the three methods: open-ended statements, the Stages of Concern question- 

0 

naire, and infonmal Interviews. Principals were also given practice /In 
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Interpreting respondents' data and how to utilize data acquired In school ° 
based settings. 1 

After several months, volunteer principals were Involved In a second 
workshop. During this time there was a review of the SoC concept, and use of 
a. case study for extension of data Intepretatlon skills. Principals were 
asked to collect SoC, data from their own faculties during the next several 
months. Then In the next workshop they refined their understandings of the 
concept, analyzed their own data and developed specific ^Interventions ^ased 
upon the concerns data, in order to facilitate Implementation of the Unified 
Curriculum with their faculties. 

The following year, shortly before the beginning -of school, all 
principals were involved in a workshop ntfhere SoC concepts were reviewed and 
participants were given practice in interpreting SoC data. A second part of 
the training was devoted to introducing the concept of Innovation 
Configuration of the Unified Curriculum. The following month, volunteer 
principals were given further practice in SoC data collection and learned how 
to formally develop a framework for Interventions to be undertaken in order to 
facilitate the implementation of the Unified Curriculum. After an Interval of 
several months, principals were asked to design a plan of interventions based 
Hipon train1ng"4n -l^veH- of -Use and data -col lected from their f acul ties . As 
was mentioned above the training for principals throughout 1? b two years was 
designed and delivered in a concerns-based way. Workshop le?Jers provided 
feedback and support to the principals in substantive ways, thus ameliorating 
their personal and management concerns about their role as facilitators/ 
instructional leaders. 
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Instructional Personnel; Staff Development for Teachers 

During the period when principals were receiving training for 
facilitating, principals and teachers were also receiving Inservlce on the 
content Cyf the Unified Curriculum. The first sessions for principals and 
teachers we^re designed to provide Information about the new program (SoC 1 
Informational Concerns) and Its Impact upon the teachers and administrators 
(SoC 2 Personal Concerns), later sessions for teachers were designed to build 
teachers' skills In actual instructional techniques, these sessions were most 
often conducted by the District mathematics specialists. The first sessions 
usually Involved several schools and were designed for resolving Informational 
and Management concerns. The latter sessions were school center based, are 
ingoing, of a support and facilitating nature, and designed to alleviate 
Management concerns. 

The institutionalization of the Elementary Unified Mathematics Curriculm 
and the ongoing implementation of the other areas of the Unified Curriculum 
(i.e., elementary communication skills program; secondary courses at all 
levels in four core areas) has been greatly facilitated by the utilization of 
resources external to the school center. Some of these have been within the 
district and other assistance has come from outside the Palm Beach County 
School system. 

Content -support for teachers and principals has come primarily from 
subdi strict mathematics specialists (there are 4 sub-districts in the county 
school system). These persons served as consultants to Individual schools 
within their jurisdiction, both in content and in the implementation process. 
Their ongoing support over a three-year period contributed to a large number 
^ of teachers reaching Routine Level of Use during that time. They provided 

both individual and group assistance and responded to concerns expressed by 
teachers in the respective schools served. 
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Also on call to provide support for personnel Involved In this change 
were professors from a. nearby public university, Florida Atlantic University. 
One of these professors was assigned full time for a two-year period to work 
with the Palm Beach County Schools* Department of Professional Staff 
Development and Teacher Education Center. His support was most valuable in 
assisting faculties. 

Policy Level Personnel: Assistance to Decision Makers 

The major source of outside assistance, however, was that which came 
t'^roughout the implementation period, from the Research and Developmej^ Center 
for Teacher Education, University of Texas at Austin. This support came In 
several forms. R&D Center staff provided both initial and follow-up Inservice 
activities for principals. These activities were designed to develop 
administrators' understandings and skills in two most appropriate areas: (1) 
how to identify ana resolve teachers' concerns about the Unified Curriculum, 
and (2) how to determine the Level of Use of the Unified Curriculum and 
subsequently how to take steps to allow teachers to Increase their Level of 
Use of the program. \^ 

Decision maker consultation. The R^I^ Center staff also served as 
consuUants to the central -Staff of the Palm |each County Schools during the 
implementation process. This process Involved n^ only workshops Involving 
central staff, but also providing advice and opinions concerning the progress 
of the Implementation effort. The consultations were prQ.vided In several 
ways: (1) via telephone; (2) face-to-face formal meetings; (3) informal 
gatherings; and (4) formal written reports. This advice was based on several 
different data sources: (1) formaA Stage of Concern (SoC) questionnaires 
administered to teachers; (2) brief Sou Interviews of teachers and principals; 
(3) Levels of Use Interviews of tiachers; (4) telephone reports from 
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principals, area and central staff; and (5) personal observations. No 
Individual person or school data were shared; all were viewed as confidential 
at the school level. 

Policy development. Reports from the R&D Center staff were usually 
filtered back to top decision makers through the Department of Professional 
Staff Development and Teacher Education Center. Thus, those charged with the 
overall direction of both the development effort and the Implementation 
process were furnished objective data upon which to systemtlcally consider and 
make decisions including program modification and program Implementation. For 
example, throughout year one of the math program Implementation, teachers 
continued to express their opinion that the math program would not really 
remain, that It "would fade away." They believed this to be true based on the 
history of other programs that had been Introduced In the district. They were 
concerned about this for two reasons: first, they thought the new prog am was 
good In that it served as a guide that provided a consistent program to all 
pupils, regardless to which school they were assigned; second, teachers had 
given a great deal of time and energy to the program and they did not want to 
see this wasted with a start on yet another "new" program. In the second year 
when the central office/ superintendent level administration became convinced 
that - th.\ s Sultua^tion - - stil 1— exl^ted^, a -precUely-~w"derf d "tnter veifTtlon 
directed from the superintendent: all sub-district "area" superintendents 
were to visit each elementary faculty in their repsective area, to Indicate 
clear conmitment to the Unified Math, to demonstrate interest by soliciting 
teachers' comments and feedback, and to do this in a highly visible, 
personalized way for maximum Impact. The policy message to be conveyed was 
that the district was adopting and Implementing long range curriculum programs 
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and that, unlike previous years, the expectation was that the program would be 
used, and for quite a long while. 

A second example of policy level activity was a change In the 
superintendent level decision makers' time line for curriculum Implementation. 
In the Initial plan math would be Implemented in one year, and 1| response to 
state level mandates, a second Innovation was to be Introduced to the schools 
at the outset of the second year of implementing math. After a few months, 
the upper administrative levels became aware of the fact that teachers were 
overwhelmed because of 1) still working to become comfortable with math, ind 

2) trying to cope with the idea of a new curriculum program. The game pllan 

\ 

was changed and an option was announced by a supertintendent's memo to a|l 
schools — the school should adjust their implementation time table in orde^ 
to respond to teachers' concerns; "slowing down" was okay. 

Monitoring and Evaluation 

Data for monitoring purposes were collected throughout the implementation 
process using several techniques ana sources. 

Program. Quarterly feedback from all teachers about the content and 
materials of the new curriculum was collected by central administrators. At 
the end of the first implementation year, an opinionnaire collected a variety 
of information about the new math program from all Involved teachers, on an 
anonymous basis. Program revisions Incorporating the teacher feedback were 
made. 

Teacher Change. Teacher SoC, LoU and Innovation Configuration data were 
acquired from selected target schools on a periodic basis. These data were 
shared with principals and assistant principals so that they could provide 
data-based support to the individual teachers. As an example the Stages of 
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Concern and Levels of Use data from one of the schools. School A Is presented 
In Figure 11. These data Indicate there was a change of teachers' concern 
about the Unified Curriculum during the Implementation process. The first 
concerns data collection point, Spring 1980, Mas at the end of the first year\ 
of Implementation of the new math program, fss data were collected three times j 
during the second year of use Stages 1, 2, 3 concerns tended to decrease with/ 
Stage 6 Refocusing generally Increasing over time. An exception to th6 

/ 

decreasing Stage 3 Management concerns occurred toward the end of the school 
year. Spring 1981, data point 4. Teachers In several grade levels discovered 
late In the year that they were "running out of time" for finishing /the 
Instructional program with their students. This realization caused their 
Management concerns to elevate to the same Intensity as period 1. School A 
teachers' Levels of Use of the program (Figure 11) changed from the m^fjorlty 
of teachers at LoU III at the end of year one. Spring of 1980^ to a 
significant number of teachers reaching the Routine Level of Use at the end of 
the second ye&r of the Implementation process. It appears that Inservlce 
training and other Interventions delivered by principals and others were 
effective In helping teachers In their Implementation efforts. Additionally, 
it was found that teachers changed In the way they used the materials In their 
classrooms, that Is, the way they used the different configuration component 
parts of the Unified Curriculum. 

Student Change. Data collected over the. last several years from State 
Assessment Tests show positive progress of students' achievement since the 
Implementation of the Unified Curriculum. For example, in 1981, third grade 
students across the district scored above state averages In 11 of 14 standards 
assessed on the mathematics test sections, and In 1981 fifth grade pupils 
scored at or aJove state norms on 14 of 24 standards assessed (see Figure 12). 
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Figure 12 

COMPARISON OF SSAT SKILL ACHIEVEMENT 
FOR PALM BEACH COUNTY AND FLORIDA 
1977 - 1981 

GRADE 3 
MATHEMATICS 

NUMBER OF ABOVE STATE ON STATE BtLOW STATE 
YEAR SKILLS TESTED NORM NORM NOf^ 

1978 14 1 13 

1979 14 1 /2 . 11 

1980 14 6 / 2 6 

1981 14 n 3 

/ 

GRADE 5 
MATHEMATICS 

1978 24 . ?4 

1979 24 24 

1980 • 24 5 1 ' 19 
1981 24 7 7 1 10 
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These gains are dramatic Increases over 1978 pre-Unlfled Mat)j Implementation 
assessments^^ 

» 

Fifth grade student scores from School A (Figure. 13) show little gain in 
achievement on the state assessment test from 197B to 1979. The 1979 tests 
were administered to students in^the fall two months after the teachers began 
use of the new math. The 198D scores showed no additional improvement in 
student gains. During this ^period teachers use of the program was at the 
Mechanical Ljevel of Use 111, not having the program yet stabilized. But, by 
- the 1981 test administration teachers had experienced two years of use and had 

> 

„moved to LoU IVA. Routine — and students Increased to 94% achievement, a gain 
of 13 percentage points over the previous two years scores. A similar, but 
not so dramatic, gain is seen with the third grade achievement. Figure 14 
provides some explicit examples of student gains on specific skills tested. 

Principals. While overall direction and commitment came from the 
district central offices the actual responsibility for implementation came 
from the school center with the principal (headmaster) being accountable for 
his or her teachers' use of the materials. A new instrument for monitoring 
principals* facilitation concerns, the Change Facilitator Stage of Concern 
Questionnaire (CFSoCQ) (Rutherford, Hall and George, 1982) was used to 
identify the most intense concerns of the three case study principals during 
1980-81. Periodic assessments made during this yearlong research" effort 
permitted the identification of principals' concerns as they changed across 
time. 

An example is provided in Figure 15. At three points in time, the 
principaTs concerns were assessed. The first period was at the beginning of 
the second year of math program implementation in the fall of 1980. Note the 
high intensity of Stage 4 Consequence and Stage 3 Management concerns. The 

« 

consistent high peak on Stage 0 Awareness suggests that the principal was not 
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STATE STUDENT ASSESSMENT TEST COMPOSITE SCORES 1978-1981 

SCHOOL A 

.. \ _ . . . • / -i^ 



1978 1979 1980 1981 

Grade 3 89% 90% 89% 96% 



Srade 5 77% 81% 81% / 94% 
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Figure 1£ 

EXAMPLES OF SKILLS ACHIEVEMENT SCORES 1^ SSAT 

School A . 



Grade 3 


1978 


1981 


Identify fractional parts of regions that have 
been separted Into halves* thirds* or fourths. 


77X 


94S 


Subtract a 1-d1g1t number from a 2-d1g1t 
number, without regrouping. 


79% 


94X 


Use subtraction without rearoublna to solve 
real -world problems Involving twa purchases 
totaling no more than 50$. ^ 


7135 


83X 


Grade 5 


1978 


1981 


Round a whole number less than 100 to the 
nearest ten. 


72% 


100? 


Identify equivalent fractional parts of regions 
that have been separated Into halves, fourths, 
fifths, eights or tenths. - 


84« 


' 99% 


Divide a 3-d1g1t number a i-d1g1t number 
with remainder zero, without regrouping. 


61% 


81% 


Add two proper fractions having like de- 
nominators, without simplification. 


69% 


89% 
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- Figure 15 
School A ^ Principal 
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unduly concerne4 about facllltattng the program end was not troubled by it. 
At the second data collection In the Winter of 1981 the Management concerns 
decreased, but Stage 2 Personal concerns Increased a good deal then fell back 
to a lower level later In the year. Spring 1981. This principal's Stage 4 
Consequence and Stage S Collaboration concerns were consistently at "peak", 
levels across all data points. 

The student change, teacher change and principal change, data all portray 
a picture of positive growth and development related to the Innovation as 
experienced by all individuals Involved In the change effort. 

Indepth data collections and documentation allowed close examination of 
the "Interventions" made by the principals with each representing one of the 
three basic types of change facilitator models. These three faclHtatCdr types 
are Identified tn: responder, manager. Initiator (Hall, Rutherford, Griffin, 
1982). Classification Into one of these categories was based primarily on a 
general impression or "perceived Gestalt" as to how the principals reacted 
when faced with the necessity to change. One Indication of their reaction was 
measure^ by the CFSoCQ (see Figure 15). 

Responder principals, as a rule, take no initiative on their own to help 
faciliate change in thei r^ irchool centers.- They are seemingly content to 
follow directions serving mainly as a conduit for administrative directions 
which come~~ftom~"a '1itgh^ ^uthorttyr — ^anager-prlncipaHr'^ may "te—primartly 
concerned with addressing the logistical aspects of the Implementation 
process, thus enabling the new program to functioi? smoothly. They, however, 
seem to be a somewhat flexible type and may seem at times to singly respond to 
situations, or they may Initiate some actions to facilitate use of an 
Innovation. Initiators, on the other hand, present themselves as persons who 

c 

take firm, decisive (albeit not a1><ays proper) action to assist in 



Implementation. This may range from actually d^eloplng and conducting 
work'Shops on the Innovation to devising novel, and. creative uses of resources 
to facilitate Implementation. This type of principal might best be described 
as Independent or autonomous. It appears from data analyses presently 
underway at the Texas R&D Center that the faculties of Initiator and Manager 
type principals score higher In terms of Implementation success than the 

e 

faculties of Refsponder style principals. Implications of the f'style" of the 
principal for the outcomes of implementation have been recently found by other 
researchers (Kwantes and Rohde, 1982). . 

Clarification and documentation of these three types of facilitator 
models once again highlight the need to view change as a personalized process. 
Just as each of these three types of principals differ In some fas'hion In 
their interventions with teachers and in their Implementation effectiveness, 
so do their support needs for the Implementation process vary. This variance 
in changing concerns and the need to support them accordingly exists both at 
any one point In time and across time, pointing out the need to view school 
change and improvement at all levels as a continuous process that does i^ot 
simply just happen. r . 

Epilogue ; 

Much ufas learned In Palm Beach County as a result of thir. first 
systematic support effort of developing and implementing a ' curriculum 
innovation for school improvement. Amo;ig the most important points are: 

1) Newly developed materials for programs need to have not only pilot 
testing but extensive field testing in a variety of user settings in order .to 
identify errors and problem areas. Because of immediate pressing needs the 
program was introduced to teachers before materials were coilipletely 
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developed. The quality, or lack of quality, the mterlals affected teac^srs 
very negatively. Increasing thein, frustration during the Initial 
Implementation activities. This lesson was sorely learned; Improved 
materials, when they were delivered, were Immensely appreciated by the teacher 
users. 

' 2) On the positive side, principals do affect teachers' Implementation 
and use of new programs and this was dramatically demonstrated by many of the 
actions taken by principals, and documented by the researchers along with 
related effects on teachers. Principals can Influence teachers and there are 
now new data and Insights Into what they do to do this. ^ 

3) Principals, like students and teachers, do not benefit very much 
from one or two day "hK and spllt^ training workshops. The principals who 
volunteered and received more frequent, shorter segments of CBAM facilitator 
ti^ainlng with feedback and coaching were, better ImpTementors of CBAM, an 
Innovation for Implementation and use by Vfnclpils to aid them In supporting 
teachers In their Implementation and use of the new math program. 

Revisiting the Two Cases 

Mn the p/*eceding sections two major case studies of school improvement 
have been summarized. In terms of the organizing framework presented In 
Figure 1, all tdree phases of the School Improvement Process were represented. 
In both cases the needs for change had risen out of local Issues and concerns. 
In each case there was a School Review. The reviews Involved many schools and 
teachers as^well as school district administrators. The problems being 
considered Included the needs of individual schools and teachers and at the 
same time represented shared concerns and larger Issues than could have been 
solved by each school Independently. 
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The Solution Selection/Development process was approached in similar ways 
by both districts. The various curriculum materials that Were available were 
surveyed. Then both districts decided to develop their own specialized 
materials that were closely linked to specific commercially available 
instructional' resources. In the Jeff Co, case the district already had formal 
policies and procedures for curriculum development. These/ policies requireo 
teacher and community involvementi pilot and field test activies and several 
checkpoints and sign-offs before an innovation could be adopted by the 
district. For Palm Beach this ^lias their first major aitempt at curriculum 
development,, which probably accounts for much of the materials related 
problems that were encountered during implementation. 

For both districts, the Splution Implemen^tion phase was approached in a 
nevi way based on resources, research findings and the ^^nvolvenient of Texas R&D 
staff. Implementation was rcjcognized to be a process and the intervention 
"game plan" was developed and jmodified in terms of teachers Stages of Concern 
and Levels of Use and the Innovation Configurations being implemented. 

Both cases of improvemeny were quite successful in terms of reaching 
their articulated goals. The V^f f Co objective was to have every classroom 
teac^ier teaching the newly revised inquiry-approach science program, so that 
all students would be exposed t^ ana involved in a process of hands on, 
student centered curriculum, experiencing the behaviors and activities of 
scientists. Since science is not cdiisidered to be a "basic skill" discipline, 
it is not subject to the close scrutlyiy of student evaluation that the typical 

i 

basic skills are. In fact, no well i^ccepted nationally standardized science 
achievement test at the elementary lev^el exists. Therefore, it is difficult 
to deal in a singular way with student 'achievement in science. Thus, student 
scores did not appear to be a primary \goal though student achievement was 

.70 

/ 

65 



\ 



doci^Riented at the sixth grade level. Therefore, the JeffCo game plan reflect^ 
an emphasis on teachers by the Implementors. It was expected that If teachers 
could be supported and learned, to demonstrate the behaviors required by the 
program then multiple student outcomes would be a pay off. Implementation was 
deemed successful and district policies about development were refined and new 

» 

policies about Implementation were established. 

The dual role functions of developing and Implementing were assigned to 
the same facilitators and proved to work well. Having designed and developed 
the program, the science coordinators had strong Interests In seeing that It 
was used by all teachers In the most faithful ways possible. In following up 

1 

on Implementation support the JeffCo facilitators found that Implementation 
increased when principals received special training and assistance. 

In contrast a strong connection between the design and Implementation 
facilitation roles was absent at Palm Beach. The courtship, early wooing and 
marriage cf these two staff groups never occured or dwindled Into early 
divorce, for articulation between the two curriculum components was poor at 
best. However, It Is very clear that the district accomplished Its goal, 
despite the lack of meticulous and detailed attention to teacher 
Implementation. The emphasis on the learning objectives of the program and 
student testing for achievement of the objectives led to exactly what was 
desired, higher student achievement scores. ' In Palm Beach concentrated 
attention was given from the beginning to preparing principals for and working 
with them In facilitating Implementation at the classroom level, though the 
lack of early communication by the district about expected teacher use of the 
new program hindered principals support. However, key Interventions from the 
policy level were Influential In clarifying the direction of the Improvement 
effort. 
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Discussion and Summary 

Much was learned In these school Improvement efforts. Coordination 
and support of Implementation across many schools was shown to be 
possible. And It was demonstrated that district wide development and 
Implementation efforts can succeed when the criterion for success are 
teacher's use of the innovation and 1nc|reased student achievement. 
Another important outcome of this work ^s confirmation of the key 
principles of the ISIP Project. The school 'improvement process can work 
if appropriate facilitation, resources and time are available and used 
effectively. 

There are also several perplexing Issues and dilemmas. Th^se could 
beconte the basis for another full length paper, however for the sake of 
brevity only a short list of key principles and issues is presented in 
the remaining pages of this papet. 

"Musts" for facilitating sctiool Improvement 

1) The Innovation processess and materials should be pilot and 
field tested before implementing with all users. The Jeff Co science 
materials and Teacher Guide were given extensive pilot testing, field 
testing and revision before they were made available to all teachers. 
In the Palm Beach case, materials were rapidly produced and immediately 
sent to all teachers. In some Instances teachers were expected to use 
materials that were not yet available. The consequences in Palm Beach 
was more variation in configurations, less clarity of expectations at 
the school level and more Management and Informational concerns on the 
parts of teachers and principals. 
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2) Provide iwore pers o nalized assistance to principals as they carry 
out their change facilitator role. Principals are people too. They are 
also individuals. AH too frequently it Is assumed that principals will 
understand and be able to carry out their change facilitating 
responsibilities simply by being directed to do so. Palm Beach and 
JeffCo principals received advance information about what would be 
expected of them and their staffs. Further, principals, particularly in 
Patifi Beach, received specialized training prior to their teachers 
receiving training. Ongoing consultation and training was provided 
during the implementation phase. When the school leader knows what Is 
to be done, s/he is in a much better position to clarify practices and 
to assist staff in accomplishing the tasks. In another recent study 
Matthews and Suda (1982) report that researcher-provided diagnostic 
information about teachers Stages of Concern could be very useful to 
principles as change facilitators. 

3) Collect Stages of Concern and Levels of Use ^ata before and at 
regular Intervals during the school review and implementation phases . 
Change is a process for individuals, groups and Institutions. Having 
standardized information at regular intervals can help all parties to 
better understand and facilitate the change effort. The SoC, LoU and IC 
information can alj^ be helpful in communicating with outsiders about 
progress that is being made. In both districts th^se data were useful 
to district level facilitators In communicating with policy makers about 
the progress that was being made. In recent work in Belgium and the 
Netherlands van den Berg and Vandenberghe have found this approach to be 
very helpful in planning and monitoring (1981). In addition, with these 
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kinds of data policy makers ^re able to see change as a process rather 
than as an event. 

4) Develop as much clarity and consensus about the operational 
components of the Innovation before Implementation, When all parties 
have had Input Into expectations and have common understanding about the 
allowed variability in use of an Innovation, implementation efforts will 
occur Mith less confusion and uncertalnlty. The JeffCo case Is a good 
Illustration. The key components of the Innovation were agreed to In 
advance and descriptions were made available to all parties. As a 
consequence everyone had the same understanding of the limits in 
adaptation and their minimum responsibilities as well as opportunities. 
Mid course corrections were made when necessary and all parts of the 
system held a common Image of where they were going. 

5) Provide workshops over time and have them targeted to 

# 

teachfer/principal concerns . For most changes, limiting formal training 
to pre-use "launch" workshops is now sufficient. As is illustrated in 
both the JeffCo and Palm Beach experiences, formal workshops were 
offered over time and were based on formal and informal assessments of 
participant concerns. With this approach timely interventions can be 
made to address concerns as they change. 

6) Developers of innovations should be directly Involved in 
facilitating implementation . In Palm Beach the developers were not 
engaged in providing school and classroom level implementation 
assistance. The consequence was that persons who were assigned to 
facilitating Implementation did not understand the intricacies of the 
innovation and they did not believe as strongly in the Innovation as did 
the original developers. The result was discontinuity between developer 




Ideals and actual use of the materials and processes. Another 
consequence was a great deal of Individual facilitator Interpretation of 
Mhat use of the Innovation meant which led to unanticipated increases In 
Innovation configurations. 

7) Develop an Intervention Game p/an In advance . Thinking out the 
overall design of Interventions that will be needed to support a school 
Improvement effort and doing this In advance Is critical. Without 
advance planning the day to day crises and problems that are a na^ral 
part of all change efforts tend to overshadow the larger picture/ With 
advance pU.mlng, all of the Interventions such as workshops, 
newsletters, new stafflngs and day to day comfort and caring, can be 
more closely Interrelated and made to compliment each other^. This does 
not mean that the Intervention game plan should not be changed with 

t V 

experience. Indeed It should- be constantly under review and refinement. 
Without the game plan In advance, there tends to be^ less overall 
continuity and support. The Stages of Concern, Levels of Use and 
Innovation Configuration data can be very helpful for making decisions 
about the various adjustments that are needecU They can also be used to 
monitor the effects of the adjustments In the intervention game plan. 

Issues for discussion 

In addition to supporting the ISIP guiding principles, the case 
experiences reported have also stimulated many conceptual and practical 
Issues among the participants. Some of these are more theoretical in 
nature, while others appear to be differences In interpretation of the 
school improvement phenomena. The following sampling of Issues are 
offered to stimulate discussion and thought about how school Improvement 
might be approached In the future. 



1) School Self Review and Implementation 

The ISIP project advocate!& a comprehensive school review process as 
the cornerstone of successful »chool improvement. This process, as we 
understand 1t» requires a school to engage In a series of steps and 
processes that Include developing an analysis of problems and needs and 
Identifying possible solutions. The review process also entails the use 
of an outside consultant. Out of the school review process "solutions" 
will be Identified. What are the mechanisms fpr 1mp]|ementation of these 
solutions? In the Concerns Based model the School Review process. 
Solution Selection/Development and Implementation of the Selected 
Solutions would be seen as "innovations." Stages Concern, Levels of Use 
and Innovation Configuration data could be collected during all three 
phases and in relation to the School Review process, the Solution 
Selection/Development and for Implementation of the Selected Solutions. 

2) Local School vs. Multl School Change 

There are many whb place heavy emphasis on individual school 
Improvement. As admirable as individual school improvement effoTui may 
be in an egalitarian sense, one reality of this approach is that each 
school will seek the beat of its own drummer with little or no 
systematic coordination with what other schools are doing. In addition, 
it is highly unlikely that a single school staff can replicate the vast 

f 

knowledge and experience base of curriculum theory, program development, 
evaluation, learning theory, etc. that are required to develop and 
implement educational improvements. More resources are available if a 
larger system such as a district or state education agency is involved 
in school improvement. 
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How can the strengths of Individual school autononiy be matched with 
the extensive bodies of knowledge and expertise that are needed to 
develop and implement quality solutions? Without some sort of larger 
design each school runs the risks of reinventing wheels and many will 
attempt to Implement untested solutions. 
3) Top Downism 

There Is a tendency to vllw the types of change efforts described 
In this paper as having been unilaterally directed out of the central 
office of the school districts. Frequently these types of efforts are 
labeled as "top down" and the Implication Is that they can't work. It 
could also be argued that they were not ."top down." However the cases 
reported here were successful. The efforts, were directed and 
coordinated out of the central offices of the respective districts but 
teachers and parents had Input Into and Influence over the review, 
development and Implementation phases.. 

Even with a single school there will be differential teacher 
Involvement with some being closer to the process than others. Rather 
than striving to have all teachers actively Involved In every element It 
could be much more personalized for teachers to have opportunities to be 
Involved as they choose and for the Improvement effort to have built In 
mechanisms that keep all teachers Informed and regularly updated. 

It does not appear that the "top down" Improvement strategy In and 
of Itself Is an Indicator of potential for success or failure In a 
change effort. Rather success or failure Is dependent upon the many 
interventions that must take place to fulfill a top down or grass roots 
strategy. Judging success or failure of a top down strategy Is closely 
linked to the criteria. If the criterion Is teacher control over the 
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change process then, by definition, top down strategies will be rated 
lower. However, if the criterion Is successful implementation at the 
classroom level or Increased student achievement, then very different 
judgments could be made. 

It appears that the School Review Process can be based on a top 
down strategy. That is, the school review process Is required, it is 
built Into the the definition of school Improvement. The selection of 
problems and solutions is open to local option. In either case In terms 
of some criteria there are ''successful schools" that ao not use single 
school review processes. 
4) Principal Overload 

The school Improvement efforts described In this paper place heavy 
responsibilities on the school principal. In addition to their normal 
Job load, they must shoulder major new responsibilities ana use 
special izeo skills to effectively facilitate school improvement efforts. 

To prepare principals for this intensive role and to help them 
carry it out requires specialized training that can only be effective If 
provided over time and closely linked to follow up and on the job 
coaching. In both the JeffCo and Palm Beach experiences principal 
training was seen as crucial. Palm Beach learned from JeffCo and did 
even more principal - training early in their effort. Both districts 
would argue that even more attention should be given to principals In 
future Improvement efforts. 

Recent research findings at the Texas Research and Development 
Center would reinforce this need (Hord & Goldstein, 1982; Hall, 
Rutherford & Griffin, 1982). These findings point out that typically 
the principal does not work alone. The effective principal works in 
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collaboration Mith an assistant principal or lead teacher and together 
they provide the needed facilitation for their teachers. In developing 
models of school improvement and thinking about the key factors that 
must be present, more consideration should be given to the role and 
dynamics of thl^ on-site change facilitator team. 
5) Memory Loss 1 

A consistent finding in CBAM studies has been thaVparticlpants 1n^ 
change efforts forget or do not accurately remember their past 
experiences. For example, although teachers were systematically 
surveyed and representatives were involved in developing sped fici at ions 
for the Revised Science Program in Jeff Co, and for Unified Math in Palm 
Beach, three years later many teachers claimed to have had no input. 

In another CBAM study, teachers were systematically asked about 
parti cular> interventions that had occured during the change process. 
Interventions were nominated that were seen as critical. Special 
workshops and key events in staff meetings where there had been much 
debate or in which strategic agreements had been worked out were 
identified. When teachers were asked to recall these, a large 
percentage of teachers did not remember the interventions at all or 
attributed the consequences to other interventions^ They would have a 
tendency to remember themselves as having accomplished more of the 
decisions and tasks by themselves with less Influence frm others than 
the historical record indicated. One Important question is, how can 
change facilitators maintain suff^jcient contact with all prospective 
users throughout a school improvement effort so that teachers continue 
to maintain ownership of the process and decision? 

i 
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6) Teacher Involvement^ ' 

The point above 1ead$. to a^reUted one. There Is an assertion In 
recent times that a11 teachers shouldbe Involved In all decisions. A 
variation of this theme Is that the only things that are credible to 
teachers are things that other, teachers develop and present. 
Undoubtedly union representatives have an Interest In this position, but 
their reasons have little do with, school Improvement. 

It appears ;that many teachers are not desirous of having "Input" on 
every decision. In fact many teachers recognize curriculum developers, 
central office personnel, and college faculties as having useful Ideas 
about teaching, school and student needs. Teachers have been heard to 
say "I don't want to spend all of my time in committees and filling out 
questionnaires. If you have something that will work well with my 
students then I will try it. I want to .teach, not do all of these other 
things." How do we balance the trust and desires of these teachers with 

\ 

the heavy requirements that a school review process demands? 
In Summary 

\ In this paper we have summarized seven years of collaborative 
efforts involving practitioners ana researchers. The shared agenda was 
to accomplish school improvement and to research the process. The 
overall conclusions are many but can be sumniarized as follows: 

Large scale school improvement efforts involving many schools can 
be successful when facilitated by principals and other internal 
agents and supported by external agents. 
We would further conclude that the School Review process is the first 
phase; the phases of Solution Selection/Development and Solution 
Implementation are equally important. And we would propose that in 
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future research on the Improvement process that ,the concerns based 
perspective can be useful In monitoring and planning for all three 
phases. 
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